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Introduction Rates of maternal, newborn and child (MNCH) mortal- 
ity and morbidity are vastly greater in low— than in high— income coun- 
tries and represent a major source of global health inequity A host of 
systemic, economic, geopolitical and sociocultural factors have been 
implicated. Mobile information and communication technologies hold 
potential to ameliorate several of these challenges by supporting coor- 
dinated and evidence-based care, facilitating community based health 
services and enabling citizens to access health information and sup- 
port. mHealth has attracted considerable attention as a means of sup- 
porting maternal, newborn and child health in developing countries 
and research to assess the impacts of mHealth interventions is increas- 
ing. While a number of expert reviews have attempted to summarise 
this literature, there remains a need for a fully systematic review em- 
ploying gold standard methods of evidence capture, critical appraisal 
and meta-analysis, in order to comprehensively map, quality assess 
and synthesise this body of knowledge. 

Objectives To undertake a systematic review and meta-analysis of 
studies evaluating the impacts of mobile technology-enabled inter- 
ventions designed to support maternal, newborn and child health in 
low— and middle— income countries. 

Methods 16 online international electronic databases of published 
scientific abstracts and citations will be interrogated for the period 
i990 to 20i4 (no language restrictions) in order to identify relevant 
studies. Ongoing/unpublished studies will be identified through 
searching international trial repositories and consulting experts in the 
field. Study quality will be assessed using appropriate critical apprais- 
al tools; including the Cochrane Handbooks 7 evaluation domains 
for randomised and clinical trials, the Cochrane Effective Practice and 
Organisation of Care (EPOC) guidelines for other comparative study 
types, and the Effective Public Health Practice Project (EPHPP) qual- 
ity assessment tools for observational studies. Blinded assessment by 
at least two reviewers, with arbitration by a third if necessary, will en- 
sure rigour. Meta-analysis will be undertaken, where possible, using 
a random-effects model. Sensitivity and subgroup analyses will be 
reported. Publication bias will be assessed. 

Ethics and dissemination Ethical approval is not required. 

Results These will be presented in one manuscript. The review pro- 
tocol is registered with the International Prospective Register for Sys- 
tematic Reviews (PROSPERO) CRD42014008939. 
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Nowhere are global inequalities more starkly evident than 
in maternal, newborn and child health. For every 100 000 
births in low income countries around 240 women die, 
compared with only 16 in high income countries, while a 
child is approximately 18 times more likely to die before 
the age of five years [ 1 ] . Although considerable progress 
has been made in meeting Millennium Development Goals 
4 and 5 there remains a substantial gap between these as- 
pirations and reality [2] . 

Preventable birth complications such as haemorrhage, ob- 
structed labour and infection, which are exacerbated by 
poor pre- and post-natal care, account for a substantial 
proportion of these deaths [3,4]. These complications can 
also result in significant long— term health consequences for 
mothers, such as obstetric fistula, uterine prolapse, incon- 
tinence, depression, chronic infections and infertility as 
well as mental or physical disability in their offspring [5,6] . 

While pathogens clearly play an important role, this exces- 
sive mortality and morbidity has been attributed largely to 
endemic failures in health and social care systems in low 
and middle income countries (LMIC) [3] , set against a con- 
text of societal challenges such as lack of education and 
knowledge, delays in help seeking and poor nutrition. 
These factors are often exacerbated by gender discrimina- 
tion, ethnic and religious division, and a lack of a social 
and political voice, as well as the more obvious economic 
and demographic barriers [2,7,8]. 

The problems described above have been compounded by 
historically weak information systems and poorly integrated 
infrastructures in LMIC [9] . However, the increasing pene- 
tration of mobile networks into these regions is opening up 
new opportunities to enable coordinated, accessible, safe, 
effective and citizen— centric health care. mHealth, or mobile 
health, refers to the use of wireless, portable information and 
communication technologies (ICT) to support health and 
health care [10]. The concept of mHealth remains somewhat 
poorly defined in the literature, although useful taxonomies 
are beginning to emerge [11]. It may be thought of as in- 
volving various devices such as cell— and smart— phones, per- 
sonal digital assistants, tablet computers, laptops and digital 
point-of-care testing devices, delivery modes such as voice, 
text, images, or video, and applications such as public health 
messaging, personalised behaviour change interventions, 
workflow management, health surveillance, access to pa- 
tient records, clinical decision support, education, diagnos- 
tics and remote care provision. Thus mHealth solutions may 
be configured to support patients, professionals and health 
systems. Although mHealth has attributes in common with 
'telemedicine' and 'telehealth' (enabling care at a distance) 
and other areas of health informatics' (eg, via digital records) 
the term is reserved exclusively for mobile and wireless dig- 
ital tools and interventions. 



Although the area of mHealth is relatively young, it has at- 
tracted considerable attention from, and investment by, do- 
nors, the private sector and development agencies as a 
means of alleviating a range of global health challenges. 
Among them, maternal, newborn and child health are key 
priorities, along with the monitoring and management of 
HIV and other infectious diseases. International collabora- 
tions such as the mHealth Alliance and development agen- 
cies like USAID are increasingly documenting experiences 
of mHealth implementation projects in this area, one of the 
best known being MAMA (Mobile Alliance for Maternal 
Action), a patient messaging system that has been imple- 
mented in several LMIC [12,13] While the significance of 
mHealth is understood, evidence of its potential value and 
impact on maternal, newborn and child health is less clear. 
Intermediate outcomes, such as improved antenatal atten- 
dance through the use of SMS appointment reminders 
[14], are increasingly being reported, although evidence of 
impacts on maternal and child mortality and morbidity 
rates is rarer [15]. Significantly, the recent World Health 
Organisation guideline on postnatal care of the mother and 
newborn identifies a need to evaluate the potential role of 
mHealth in improving patient outcomes [16] . 

To date, the majority of mHealth implementation projects 
in LMIC have tended to be small— scale, donor-funded ini- 
tiatives, which have taken place without the benefit of an 
adequate evidence-base, and have not themselves been 
configured with research in mind. However the area is be- 
ginning to attract greater research attention and funding, 
with a growing body of studies examining the appropriate 
design of mHealth interventions for patients and profes- 
sionals, their impacts on the processes and outcomes of 
care, and the barriers and facilitators to scaling up [14,15] . 
Challenges include the difficulties of undertaking rigorous 
trials in projects driven by development or policy goals, at- 
tributing cause and effect where both interventions and the 
environments in which they are delivered are complex, and 
designing and targeting interventions for greatest impact. 
For example, a recent trial of text— messaging to encourage 
attendance at antenatal care suggested improved uptake of 
preventive care services but the authors acknowledge that 
randomisation at the level of health facilities rather than 
individual patients may have failed to capture women at 
earlier stages of pregnancy, for whom community-based 
recruitment might have been more appropriate [11]. Re- 
viewers such as Tomlinson et al have also stressed the im- 
portance of adapting tools to suit the context and culture 
of care in order to optimise their likely impacts [15] . 

A number of systematic reviews on the topic of mHealth 
exist but these are not ideally suited to establishing impacts 
on MCNH outcomes in LMIC, in some cases due to the 
absence of certain databases likely to capture research from 
these regions [17,18] or because they are concerned more 
with methodological and process issues than patient out- 



June2014 • Vol. 4 No. 1 • 010407 



2 



www.jogh.org • doi: 10.7189/jogh.04.010407 



Study Protocol - The effectiveness of mHealth interventions for maternal, newborn and child health in low- and middle-income countries 



comes [19]. The majority of secondary literature specific 
to mHealth for MCNH in LMIC consists of broad expert 
reviews summarising activities and aspirations and descrip- 
tive case studies illustrating how mobile technologies are 
being used to support the strengthening of health systems 
[20-22]. Although these provide valuable insights, many 
are vision— driven rather than evidence— seeking and the in- 
fluence of the mobile telecommunications industry can be 
hard to disentangle. A project to map the state of the evi- 
dence on mHealth and MCNH was recently undertaken by 
Philbrick for the mHealth Alliance [22]. This converged a 
literature review with a landscape scan of existing projects 
and interviews with key respondents to provide a break- 
down of studies in this area, their limitations and their im- 
plications for research and policy. While the report is use- 
ful, the mixed— methods 'gap analysis' exercise was not 
configured as a formal systematic review and is thus likely 
to have missed important sources of evidence and steps in 
the critical appraisal of study methodology which would 
be expected in a classic systematic review. Two other quasi- 
systematic literature reviews addressed the topic using ba- 
sic search terms and a subset of six databases [23,24]. A 
systematic review project selected for funding by the Alli- 
ance for Health Policy and Systems Research in 201 1 [25] 
remains unpublished, as is the case for a systematic review 
undertaken for a Master's degree project at the University 
of Edinburgh, which focused only on SMS messaging for 
prenatal care [26] . We are therefore confident that there is 
a clear need for a new systematic review employing gold 
standard methods of evidence capture, critical appraisal 
and meta-analysis, in order to comprehensively map, qual- 
ity assess and synthesize existing evidence of the impact of 
mobile technology— enabled interventions on maternal, 
newborn and child health in low and middle income coun- 
tries. The current study will follow the rigorous methods 
advocated by the International Cochrane Collaboration in 
order to achieve these aims and the findings will be inter- 
preted with reference to relevant theoretical and policy per- 
spectives, in order to derive recommendations for research 
and practice. In this protocol we describe the steps that are 
planned in order to undertake this systematic review. 

DESIGN 

This is the protocol for a systematic review and meta-anal- 
ysis of the literature. 

AIMS AND OBJECTIVES 

To undertake a systematic review and meta-analysis of stud- 
ies evaluating the impacts of mobile technology-enabled 
interventions designed to support maternal, newborn and 
child health in low— and middle— income countries. 



INCLUSION AND EXCLUSION CRITERIA 
Included interventions 

We are interested in any intervention delivered using mo- 
bile ICT, which is designed to support the health of preg- 
nant women and their unborn children, women during 
and after childbirth, newborns, infants and children up to 
five years and the national, state, city, or community level 
in an LMIC setting. 

Mobile ICT refers to portable, wireless digital devices usu- 
ally (although not exclusively) supported by networked 
mobile or satellite communications infrastructures, such as 
cell-phones, smart-phones, satellite phones, personal dig- 
ital assistants, enterprise digital assistants, tablet comput- 
ers, laptops, portable media players and gaming consoles, 
Radio Frequency Identification Device (RFID) tags, Global 
Positioning System (GPS) trackers and digital diagnostic 
devices [27]. mHealth interventions involve a range of de- 
livery modes such as voice calling, Voice over Internet Pro- 
tocol (VoIP), text messaging via Short Message Service 
(SMS), transfer of still or moving images via Multimedia 
Message Service (MMS), multimedia downloads, or live 
video [17] . Within the scope of this review we include all 
applications of these technologies for directly supporting 
MCNH patients — such as public health messaging, person- 
alised behaviour change communications, self— care infor- 
mation and remote care provision, as well as interventions 
designed to enable trained or lay health workers to provide 
better care to patients - such as electronic medical records 
or care plans for supporting individualised care; decision 
support tools for informing screening or intervention deci- 
sions, workflow planning applications, clinical documen- 
tation tools, global positioning tools for patient tracking 
and portable point-of-care testing devices able to transmit 
data via mobile phone or satellite networks. 

Included study types 

The following study designs will be potentially eligible for 
inclusion: 

• Randomised controlled trials (RCTs, quasi-RCTs, Con- 
trolled Clinical Trials - CCTs). Study designs included by 
The Cochrane Effectiveness Practice and Organisational 
Care (EPOC) group - (controlled before-and-after stud- 
ies, interrupted time series studies), 

• Cohort and case-control studies. 

Types of participants included 

The following types of participant will be potentially eli- 
gible for inclusion: 

• Pregnant women, 

• Women in ante-natal, intra— natal and postnatal periods, 

• Newborns, 
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• Children aged 0-5 years, 

• Health workers through which an intervention aimed at 
improving the health of the above groups is mediated. 

Excluded interventions 

This review will exclude interventions focused on repro- 
ductive health (eg, promotion of HPV vaccination), sexual 
health (eg, domestic violence reporting) or sexually trans- 
mitted diseases (eg, antiretroviral treatment (ART) compli- 
ance reminders), unless pregnant women or mothers of 
newborns or children 0-5 years are specifically targeted 
(many pregnant women in LMIC have HIV). 

mHealth interventions aimed at managerial or financial as- 
pects of health systems (such as stock control or account- 
ing) will not be included in this review. 

Studies describing physically 'mobile' clinics or services 
will be excluded unless mobile ICT is a fundamental me- 
dium through which the service is delivered. 

Excluded study types 

The following study types will be excluded: 

• Studies undertaken in high income countries, 

• Expert opinion, 

• Descriptive case studies and case series, 

• Technical reports and reviews. 

Types of participants excluded 

The following types of participants will be excluded: 

• Men, adolescent males and boys over the age of 5 years, 

• Women, adolescent females and girls over the age of 5 
years who are not pregnant, have not recently given birth 
or are not caring for their child aged 0—5, 

• Facility managers and government decision makers not 
directly involved in the care of patients. (mHealth inter- 
ventions such as clinical dashboards may support high- 
er-level administrative functions associated with the op- 
eration of MCNH services but do so indirectly). 

Types of comparisons 

Included studies will be those comparing the mHealth in- 
tervention with usual care, another intervention or a non- 
exposed control group. 

Types of outcome measures 

The following outcome measures will be included: 

• Primary outcomes: all outcome measures indicative of 
maternal mortality; maternal morbidity; newborn and 
child mortality; newborn and child morbidity 

• Secondary outcomes: number of planned antenatal and 
post natal visits; number of unscheduled care visits and 
emergency care incidents; quality of life; quality of care 
(delivery by skilled birth attendants, appropriate use of 



evidence— based medical and obstetric interventions 
where available); self— efficacy; cost— effectiveness; im- 
munisation cover; child developmental milestones and 
mHealth intervention-related adverse events. 

SEARCH METHODS 

Eligible study reports will be identified from the following 
sources: 

• The Cochrane Library (Cochrane Database of Systematic 
Reviews, Cochrane Central Register of Controlled Trials 
(CENTRAL), Cochrane Methodology Register), MED- 
LINE, EMBASE, CINAHL, PsycINFO, AMED, Global 
Health, TRIP ISI Web of Science (Science and Social Sci- 
ence Index), WHO Global Health Library, IndMed, Pak- 
MediNet, KoreaMed, NHS Health Technology Assessment 
Database, African Index Medicus (encompassed in the 
WHO Global Health Library), and POPLINE. Studies will 
be identified using subject headings appropriate to each 
database as well as free-text terms. In addition, reference 
lists of articles of interest and citations to included articles 
will be screened for additional eligible published studies. 

• Unpublished and in progress studies will be identified 
from the following trial registries: www.clinicaltrials.gov; 
www.controlled-trials.com; www.anzctr.org.au; http:// 
www. who .int/ictrp/en/. 

• Expert consultation. 

The search strategy is presented in detail in Tables 1 and 2. 
Restrictions include: 

• Time span: 1990—2014. (Rationale: the first mobile— health 
technology interventions started in the early 1990s) [20] . 

• Language: none (for foreign language papers translations 
will be sought) 

• Countries identified as low or medium income according 
to the United Nations Human Development Report re- 
leased in March 2013 [28], We are aware that the posi- 
tion of countries in such indices changes over time and 
will note the date of the articles. We will also include ar- 
ticles referred to using the generic terms used by other 
authors to describe LMIC (eg, developing country, emerg- 
ing economy) [29,30]. 

STUDY SELECTION 

Each author will be assigned one or more databases to 
search using an appropriately adapted version of the strat- 
egy described above (mindful of database differences). Re- 
trieved titles and abstracts will be collated and distributed 
to pairs of authors for independent screening in order to 
identify potentially eligible studies. Disagreement will be 
resolved by consensus, or arbitration involving a third au- 
thor where necessary. Full text articles will be retrieved for 
selected studies, and two authors will assess whether each 
of these meets the set inclusion criteria. Disagreement will 
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Table 1 . Search strategy: Medline format 



Table 2. Search strategy: free— field format 



1. (eHeallh or e— Health). mp. 



2. (mlleallh or m— health or mobile health). mp. 

3. Telemedicine/ or (telecare or telehealth care or mobile telehealth 
care or mobile telemedicine or mCare or m— care).mp. 



4. apps or mobile applications/ 



5. (mobile communication or mobile technology or mobile devic*).mp. 

6. Computers, Handheld/ or Microcomputers/ or (tablet computers 
or mobile tablet computers or mobile technolog*).mp. 



7. Communication satellite.mp. 



8. Cellular phone/ or (cellular phone* or cell phone or mobile 
phone) .mp. 



9. MP3 player*.mp. 



10. Text Messaging/ or (texting or text messag* or messag* or text* or 
short message or SMS or multimedia technol* or multimedia 
messag* or multi— media messag*). mp. 

11. (Personal digital assistant* or PDA).mp. 



12. (Smartphone or smart— phone). mp. 



13. (podcast* or pod-cast*).mp. 



14. Social media/ or Social networking/ or (Twitter or Facebookj.mp. 

15. (Global positioning system or GPS).mp. 



16. Radio Frequency Identification Device/ or RFID.mp. 



17. or/1-16 



18. Pregnancy/ or Pregnant women/ or Pregnancy outcome/ 

19. Parturition/ or childbirth. mp. 



20. Obstetrics/ 



21. Maternal Health Services/ or matern* 

22. (pregnan* or maternal or maternal health) .mp. 



23. Labor, or Labour or Obstetric/ 



24. Delivery, Obstetric/ 



25. Midwifery/ or Traditional Birth Attendant. mp. 

26. Postpartum period/ or puerperium.mp. 

27. Delayed deUvery.mp. or three delays.mp. 

28. Pregnancy complications/ or Obstetric Labor complications/ or 
Obstetric Labor, Premature/ or Puerperal Disorders/ or Depres- 
sion, Postpartum/ or Maternal Mortality/ 

29. Infant, Newborn/ or neonat*.mp. 

30. Prenatal Care/ or Perinatal Care/ or Postnatal Care.mp. 

31. (Antenatal care or intrapartum care or postpartum care or 
post— partum care or puerperal care).mp. 

32. (Perinatal complication* or postnatal complication*).mp. 

33. Birth injuries/ 

34. Breastfeeding/ or (breastfeeding or breast-feeding). mp. 

35. or/18-34 



36. Intervention studies/ or experimental stuclies.mp. 



37. analytical stud*.mp. 



38. Clinical trial/ or Controlled Clinical Trial/ or Randomized 
Controlled Trial/ or (clinical trial or controlled clinical trial or 
randomized 

controlled trial) .mp. 

39. Double-Blind Method/ or Single-Blind Method/ or (double-blind 
design or single— blind designj.mp. 

40. Placebos/ or Random Allocation/ or random*. mp. 

41. (Controlled before and after stud*).mp. 



42. Interrupted time series.mp. 



43. Cohort studies/ or (.cohort stud* or cohort) .mp. 



44. (control or healthy control) .mp. 



45. Case— control studies/ or case-control stud*.mp. 



46. or/36-45 

47. 17 and 35 and 46 



48. limit 47 to yr = "1990-2014" 



49. limit 48 to human 



be resolved by discussion amongst reviewers, with referral 
to a third author if necessary. Reasons for exclusion of stud- 
ies will be noted. All authors will discuss and agree the re- 
fined list of included studies. 

QUALITY ASSESSMENT AND ANALYSIS 

The assessment and documentation of the methodological 
quality of included controlled trials will follow the Co- 
chrane approach using the methods detailed in section 
eight of the Cochrane Handbook for Systematic Reviews of 



(mHealth or m— Health or eHealth or e— Health or telemedicine or mo- 
bile health or mobile telehealth care or mobile phone or cellular phone 
or personal digital assistant or mobile tablet computers or smart phone 
or mobile technology or apps or mobile applications or text messag* or 
short messag* or SMS or multimedia messag*) 
AND 

(child* or infant* or baby or babies or neonatal or newborn* or pre- 
term* or prematur* or pregnan* or pregnant women or mother* or 
obstetric labor or obstetric labour or obstetric delivery or obstetric labor 
complications or midwifery or traditional birth attendant or perinatal 
care or prenatal care or antenatal care or intrapartum care or postnatal 
care or perinatal complications or postnatal complications) 
AND 

(analytical stud* or epidemiologic* or compar* or evaluat* or follow- 
up or follow up or prospective or retrospective observation* or cohort 
or case— control or trial* or RCT or controlled before and after study or 
interrupted time series or intervention* or prospective or retrospective 
or control* or double— blind or single— blind or random*) 



Interventions [31]. Intervention studies will be assessed 
using the Cochrane Effectiveness and Practice Organisation 
of Care (EPOC) guidelines [32,33]. The following seven 
parameters will be used to assess trial quality: random se- 
quence generation; allocation concealment; blinding of 
participants and personnel; blinding of outcome assess- 
ment; incomplete outcome data; selective reporting; and 
other biases. Each parameter of trial quality will be graded: 
A — low risk of bias; B — moderate risk of bias; C — high risk 
of bias and an overall assessment for each controlled trial 
using the same three criteria will be made. Observational 
studies will be similarly assessed using the Effective Public 
Health Practice Project (EPHPP) quality assessment tool for 
quantitative studies [34] . Reviewers will not be masked to 
study details. Agreement of reviewers on methodological 
quality assessment will be assessed and disagreements will 
be resolved by discussion. 

All assessments of study quality will be performed by at 
least two reviewers (UN, CP) with any disagreement re- 
solved by consensus, or arbitration via a separate reviewer 
where necessary. 

DATA EXTRACTION 

Two reviewers will independently extract data using cus- 
tomised data extraction forms. The following information 
will be extracted: 

• Author and year, 

• National affiliation of author and funding source, 

• Country in which the study took place, 

• Study design, 

• Healthcare setting, 

• Target users, 

• Type of mHealth intervention — device; delivery mode; 
application type; stated purpose of intervention; theo- 
retical basis if specified, 

• Range of outcome measures described - maternal mor- 
tality and morbidity, newborn and child mortality and 
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morbidity, emergency care, quality of life, quality of care 
(delivery by skilled birth attendants, appropriate use of 
evidence-based medical and obstetric interventions 
where available), immunisation rates, and cost-effective- 
ness of interventions, 
• Key findings from each included study will be sum- 
marised and tabulated. 

DATA ANALYSIS 

Data will be presented in tabular and narrative form. Where 
possible, meta-analyses will be performed on methodolog- 
ically comparable studies (comparable particularly with re- 
gards to the study design, type of ICT and endpoint mea- 
sures studied and assessment methods of these) reporting 
main, primary, and secondary outcomes. The meta-analysis 
results will be presented in forest plots. The choice of sta- 
tistical tests will depend on the nature of the outcome vari- 
able. Application of either a fixed effect or random effects 
model will be dependent on the degree of heterogeneity. 
Heterogeneity will be assessed both qualitatively and quan- 
titatively using I 2 statistic. Where possible, adjusted effect 
estimates will be pooled in meta-analyses using generic in- 
verse-variance analysis. Point estimates and 95% confi- 
dence intervals will be reported for all analyses. Sensitivity 
analyses will be performed in subgroups of study quality 
and of design characteristics (eg, randomised vs non-ran- 
domised; prospective vs retrospective). Where relevant data 
are missing, we will contact authors to request these. In ad- 



dition, will undertake appropriate sensitivity analyses to ad- 
dress the different scenarios of missingness to be observed 
by making appropriate assumptions of each missing sce- 
nario. Finally, we will provide relevant discussion of the in- 
fluence of missing data on the observed findings. 

Where the number of included studies per outcome is suf- 
ficient, publication bias will be assessed visually through 
Funnel plots and tested by Egger's regression test [35] and 
Beggs rank correlation test [36] . 

ETHICS AND DISSEMINATION 
Ethical issues 

As only previously published studies are included and re- 
ported in the review, no additional formal ethical assess- 
ment and no informed consent is required. 

Publication plan 

The systematic review protocol is registered with the Inter- 
national Prospective Register of Systematic Reviews (PROS- 
PERO) CRD420 14008939 (http://www.crd.york.ac.uk/pros- 
pero). Findings will be summarised in a single manuscript. 

Timeline 

Start date: 6 January 2014 
Finishing date: 30 June 2014 
Reporting date 30 June 2014 
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